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INTRODUCTION 



Thiis technical report contains the purpose of, procedures for, and 
findings from each instrument employed in ther collect ion of data 
relevant to the major* decision antf evaluation questions of the 1980-81 
Ti^e VII Pye-Kintiergarterjr Program* 

This ^s not intended to be a document for, wide-spread circulation f 
rather a technical reference for those interested in* replicating or 
studying the research- and evaluation associated with the project • \ 

No attempt is madd here to brii^g together the various, findings in £n 
'effort to discuss ' interrelationships or implications. For. this, the 

reader is referred to the Final Report, included in the 1980-81 
* Evaluation Findings , Publieation Number '80. 32. 

> The Title VII Pre-Kindergarteh Program s'chools^ are: ' « 

Allan Brooke \ Govalle 

Allison • Becker , - \Sanchez 
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GLOSSARY 



ORE - Office of Research and Evaluation 

LEP - Category of students who a) have a non-English language- in their home, 
^ and b) are l?elow acceptable proficiency levels in oral English skills. 

Project Student -/A student t*ho is enrolled in Title VII Pre-Kindergarten. • 

Spanish Monolingual -'Category of students who speak only Spanish as deter- 
mined, by a score of 0 in English on the PAL. ¥ 

Spanish Dominant'- Category of students who speak Spanish better than English 
as determined by a Spanish PAL. score at l^sst 13 points higher than an' 
English score;. or 1 if given the PAL in English only, a raw score of Qt84 

~. < 
Bilingual - Category of students who speak both English and Spanish ^equally 
- : * well as determined by PAL scores in English and Spanish which are 12 
m or fewer points apart. This category does not apply to students 
given the PAL in English only. 

Eng/ish Dominant -.Category of students who speak Epglish better than Spanish 
*as determined by an English PAL score at least 13 points higher than 
a Spanish score; or "if given the PAL in English only, a raw score of 
* 85 or higher. ( 1 

English Monolingual - Category of students who do not speak-Spanish as 

determined by a score of 0 in Spanish or the PAL. This categqry t 
does not apply to students given the PAL in English only. * 

Level of Significance - A statiscal term used to express the degree of 

confidence that differences found among scores -are true differences 
and not chance differences. t 

SSL - Spanish' as a second language. ^ 

ESL -English for speakers of other languages.' ^ 

U.T. - University of Texas at Austin, Computation Centef . , 
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80.79 Iasv rufflcnc Description: Peabody Picture Vocabulary Test, English Version 



3rier\teacription of the instrument: 



The Peabody Picture Vocabulary Test fP.P.V.T.) is a standardized vocabulary test 
which provides an estimate of the subject's verbal ability 



To when was the Instrument administered? 



To participants in the Title VII Pre-Kindergarten Program. 

/ 



How many cjwi was the Instrument administered 
Twice. First as a pretest with forms A & B/ Secondly, as a posttest ,with Form L. 



When was the Instrument administered? 



The test was administered in October 1980 and April 1981. 

• ( 

Where was the instrument administered? 

The P.P.V.T. was administered at the designated Title VII Pre-Kindergarten scnools. 



Who a&ainistered the instrument? 



A temporary Bilingual tester hired specifically for P.P.V.T. testing. 



What training did the administrators have? 

The administrator was proviflfcd ,with taanual of instructions included with the test- 
ing material. She also haa* pmvious experience with this test. 

Was the instrument administered under 3t3ndardi2ed conditions? 

tes. Individual variations siay have occurred since it is a one-co-one cest. 



Wersitfrere problems with the instrument or *"he administration that aighc 



affect the validity of the cjtta 



Mone whatsoever 



Who developed the instrument? 
Lloyd M. Dunn, Ph.D. & Leota M. Dunn 



What reliability and validity data are available on the instrument? * 
Split-half correlations were obtained. Use of Rasch-Wright latent trait methodology 
s6lved the problem of a direct odds and even split-half since each set of items 
would have ^included items below the basal. The split-half reliabilities for child- 
ren^«ntr^outh ranged* from .67 to .88 on Form L. The issues of content, construct, 
and criterion-related validity are discussed in pp. 58-67 in the P.P.V.T.-R Manual. 

Are there norm data available for interpreting the results? / 

Yes. Standard Moras are provided. * 

v. 
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Peabody Picture Vocabiliary Test * 



Purpose 



% 

The selection and administration of the Pjeabody Picture Vocabulary 
Test (PPVT) was used to address the following decision and evaluation 
questions: 

*■ 

Decision Question No* 2 : Should the Bilingual Program be 
adapted by District? 

Evaluation Question D3-1 : Is there a long term effect 
on language and/or concept development? 

Evaluation Question D3-2 : Has tHe Program impacted 
English language skills? 



Procedures Used to Collect Data 



TJie Peabody Picture Vocabulary Test, English version, was administered 
twice during the 1980-81 school year (First Year ffcr the Program) to 
Title VII Pre-Kindergarten -participants. In December 1980 a sample of 
57 pupils was tested, with PPVT Forms A or B. In April of 1981, the 
participants, wjere re-tested with Form L. This form is part of the " 
P.P.V.T.-R which is a revised version of the original test. The 
revised test includes updated standard scores, new drawings reworked 
from the original for better racial balance, and additional items 
to increase sensitivity. The instruction booklets include tables 
for converting raw scores from forms A and B to equivalent scores 
of the L form test. 

The tests were administered in each Title VII Pre-K schoo^ by \ 
bilingual tester, in rooms providea by the school for testing purposes 

• 

Several procedures were used to render the data collected meaningful. 
■The lack of a control group, due to the belated approval of funds 
and* the consequent tardiness in implementing the Program impaired 
the evaluation project somewhat. The lack of a control group pre- 
cluded the possibility of demonstrating the program's effect in an 
unequivocal manner. Next year the availability of a control group 
is anticipated. This year an examination of gain scores must suffice. 
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The raw data are stored at U.T. using the format specified by Figure A-l: 



Columns 



Variables 



Specification 



1-3 

5-7 

$-26 

27-29 

31^32 

34-35 

38-39 

41-42 

44-45 

47-48 

,50-51 

53 

55^56 
58-59 

63, 



* I.D. number 
'School code 

Student's nams 

Age 

P.P.V.T. , raw spores 
Percentile scares 
P.P.V.T.,- raw scores 
. Percentile scores on L 
Converted raw scores 

• Converted' raw scores 
Percentile scores 

' Student f s* classif ication 
P.P.V.T., raw scores 
P.P.V.T. , raw scores - 
Interpretation of L 



Forms A or B, English Version Pretest 
English Pretest, .Forms A or B 
Form L 

Form L -to A 

.Form A to L , *, 

A to L scores / 
LEP^l,, Non-LE?=2 ' w 
Pretest, Spanish version 
Posttest, Spanish version 
a: extremely low score 
low score * 
average low score 
average higtf score" c . 

high score * * , 

extremely high score 



Figure A-l. VARIABLE LIST. 

the -data may be accessed .under the file name of ARMA in the Bilingual Program 
Evaluation Files. 



Find 



Results indicate that the English vocabulary of the participants significantly 
Improved from pretest to posttest (see Figure A-2). There was a gain of 12.5 
raw score points. - Unfortunately/ due to the lack of a control group it cannot 
be established at this point if the Program's activities and curriculum were 
responsible for the improvement. Certainly, at least some of the demonstrated 
growth must be attributed to' the normal growth patterns. 

Figure A-3 is a table of frequencies for the raw scores according to a refer- 
ential classification. This classification Is provided by the test designers. 
The columns corresponding to the pre- and posttests sfrow hov 'some of the child- 
ren havej' increased their skills. It £lso depicts the need for ^action to^fe&i^ 
' language development. The categories are established in terms of a national 
standard. 

The Program has not been in operation long enough to be able to address the 
issue of a long term effect of theProgram (Evaluation Question D2*2). However, 
the data collected this year will be used in future assessments of longitudinal 
effects. 
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Figure A-2. COMPARISON QF MEANS.- Pre- to Posttest Gains on the- P.P.V.T 



EngliJ| Version.' 



' 12 



No. of 
Students 



30. 



20. 



10. 



V* 



4-, . « 



23 



10 



13 J 



18 



4 



ft!:.: 



£2 



29 



C lassif ication . 
I 



B **4 

Pretest 



D 

Post test 



E 



A= Extremely low score 4&8%* 

Low score 265% 

C'= Average (low) 22.6% 

D= Average (high) 41% 
E= 'Hi gh score^ 
F= Extremely hfgh score 



2<X4%- 
367% 

3as% 

41% 



*Percenta"ge of students 

^Figure* A-3. CLASSIFICATION OF PRE- AND POSTTESTED STUDENTS ACCORDING 
TO P.P.V.T. \ljNTERPRETATiVE CLASSIHCATION. 
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80.79 Iastruaent Description: Peabody Picture Vocabulary TeaTc, Spanish Version 



0 



Brief description of the instrument : y/ 

The Spanish P.P.V.T. is based on the English version. ^The "same cue pictures were 
utilized*. The test is based «n a Guttntan scale. 



To vhca was the Instrument administered? 
To title VII Pre-Kindergarten Participants.' 



Stow many times was che instrument adminisifered? 

Twice. First to a sample of 57 children. Secondly to 96 participants. 



When was the instrument administered? 



The pretest-«/as administered in December 1980. The pdsttest was given on April 
1981. 



Where was the instrument administered? 



In designated rooms, chosen by the School administration, in each of the six Title 
VII Pre-Kindergarten schools. 

( 

Who administered the instrument? 

The pretest was administered by a temporary 3ilingual tester hired specifically for 
P.P.V.T. testing. The posttest was administered by the evaluator-; wno is a Spanish 
speaker. 

w 

m - • 

What training did the administrators have? 

The administrators were provided with the manual of instructions included with the 
testing materials. Since the Spanish version procedures follow the English version, 
instructions from the test designers were followed. &oth administrators were train- 
ed by O^R.E. personnel. 1 

s 

Was the instrument administered under standardized conditions? 

Mostly yes. In one case during the posttest a few words were changed to test a 

Colombian child. For example, (bote for lata). 

1 

Vara there problems with the instrument or the administration chat night 
affect the validity of the data? 



Yes. Some words were unknown to all children. The number of words considered 
problematic is not large enough or located within the same basal as to affect the 
scores negatively. 



-<:-' • 



Who -developed the instrument? 



The Peabody Picture Vocabulary Spanish Version was designed by Ann Washington from 
the Mac Allen Independent School District. . ■ 



What reliability and validity data are available on the instrument? 
Nona.' ^ 



Are there nora data available for interpreting the result's"? 
So. 
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Peabody Picture .Vocabulary* Test r 



W- r Purpose 

The selection and administ ration of the Peabody Picture Vocabulary 
Test (£ .P.V.T) Spanish Versian'was used to address the following 
decision and evaluation cfuestdons: ^ 

\ Decision Question' D2-2 : Should Xhe Bilingual Program be 
. adopted by the District? 

Evaluation .Questions D3-3 : Has the Program impacted 
Spanish -language skills? 

% " • k - ' 
Procedures JJsed^ to follect Data 

The Peabody Picture Vocabulary- Test , Spanish Version, was administered 
twice during the 1980-81 school year (First Year of the Program) to 
Title VII Pre-Kindergarten participants; A sample of 57 was tested 
during December f Later, 96 stude£it;s,< including those previously 
tested, were retested in April. v ♦ 

The testa were administered by bilingual personnel firom O.R.E. They^ 
were instructed and trained on the testing procedures. Training 
practices were Conducted. 

f 

» *«* ~* 

Several procedures were used to render the ^ata collected meaningful. 
The lack of a control group, due to the belated approval of fundings . 
and the consequent tardiness in iutplementing the Program impaired the 
evaluation, project somewhat. Tfie^laCk of a' control group precluded 
the possibility of demonstrating a program ^ffect in an unequivocal 
manner. Next year the availability of a control group is anticipated* 
This year an examination of gain* scores must suffice. 

The raw data are stored at U.T. The data file may t>e accessed under 
the file name of ARMA cm the Bilingual Program Evaluation Files. For 
the variable format please see Appendix 

, , Findings 

Results indicate that the Spanish vocabulary^o'f the particpants signi- 
ficantly improved' from pretest t^> ^dteettest . There was a gain of four 
raw scord points. Figure B-l shows the gains achieved by the students 
who were tested twice. * 
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The gains achieved in Spanish are considerably lower th&n in English* 
Such results were expected since English was the language that* pre- 
dominated in ever^ Title VLI Pre-Kindergartfen class .(See -Appendix C 
Teacher's Interviews). Due to the laqk of control group, the effects 
of the Program cannot he distinguished from normal growth patterns 
kad home instruction. ■ . 



The raw score distribution of the spring (Apo;il) Spanish P.P.-V.T. 
score is provided in Attachment 1. With this distribution and next 
year's spring distribution more reliable 'local percentile norms may 
be established. - »■ 
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« N PRETEST 
MEAN 



POSTTEST DIFFERENCE BETWEEN t 
MEAN T MEANS 



50 



19.9 

SD 

11.1 



T 



24 .4 

SD 

10.6 



4.5 

SD 

8.0 



• less- 
4.02 than 
' .0001 



Figure B-l. COMPARISON OF MEANS. Pre- to PosttesC Gains of Che P.P.V.T., 
Spanish Version. 
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^ . Attachment* "B- 

Percentile Distribution of Pbsttest Scores on the P.P-.V.Tl* Spanish 
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36 
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P.P.V.T. Spanish Raw Score Frequencies 

Raw Scores Frequency Raw Score . Frequency 



t 2 23 *' 1 



4 .3 " » \ ' 5 

5 3 . ,X25 3 

6 S 3 27 • .2 

7 6 3 28."1 

8 2 30 1 2 

9 1 A' 31 . • A 

10 * 1 " 32. 2 

11 1 '34 • 1 

12 3 35 1 
14 5 • 36 »4 
15* 1 ' 37 *5 

16 • „ 1 38 4 

17 3 j 40 -s 1 



4i y 



19 4 48' 1 

20 • 7 - / 49 - .2 
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80,79 * , In/truaent Description: Teechers Interview 



Brief description of che f n«grpg*nt; 

The interview protocol Is a llJt of open-ended questions that cover the. 
following copies: Parent participation, curriculum, Program- administration, 
and Draining activities, 



To gfaca was the instrument administered?* 
To all Title, VII Pre-Kindergarten Teachers* 



Hoy many times vaa the Instrument admlnis tared? 
Only ones. 

When was tha instrument administered? 
Last week of May,' 1981, 



Vhere yes the Instrument a (fa 1 nil tared? 
At the Title VII Pre-£ schools. 



Vbo admlnis tared the instrument? # *. 

Evaluation Intern for Title VII Pre-Kineer garter f ^ 

What graining did the administrators have? 

The interviewer had previous experience interviewing. 



Was the «^ «^*»«**> administered under standardi zed conditions? * 
"tes ~ ^ 

Vera chare problems with the instrUaent or the administration that night 

affect the validity of the data? ^ i 

tone, whatsoever* * 



, Who developed* che instrument? * 
Svaluatiori Intern for Title VII PreMtindergarten 



What reliability and validity data are available on che instrument? 



Hone. 



Are there norm data available cor interpre ting che results? 
No. 



TT 
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TEACHER'S INTERVIEW 



t ^Purpose * j s 

Teachers are in contact with Important Program's components that are 
subjects of evaltf^tiofi. Therefore it was felt that their concepts, 
attitudes and opinions needed to be surveyed. The purpose of the 
Teacher's I,ntkrview was to address the following, decision and evalua- 
tion-*questions: • » 

' * / 
Decision Question D-l ; Should the Bilingual Pre*-K Program be 
adopted by the District? ^ 

Decision Question D-2 : What components of the Program should the 
: District adopt? 

* » 

' Evaluation Question D2-1 : Has a curriculum typology teen 
- developed, 'adapted or adopted^ 

C l Evaluation Question D3-6 : Determine the degree of teacher 

• ^satisfaction with training quality and appropriateness. 

Evaluation Question D3-5 : In what dreas do teachers perceive 
'the need for additional training? , 

" Evaluation Question D3^6 : What areas of training provided by 
Title VII do teacher^' perceive as most beneficial? 

J ■ 

Evaluation Question D3-7 : How do limited English proficient 
' parents interact with the schools? 



4 



Procedures Used' To Collect the Data 

All Title VII Pre-Kiadergarten teachers were interviewed by the evalua- 
toij. The interviews were held at each school during the last week in*>, 

1081 and were conducted in a semi-formal manner. The same 
questions were asked of all teachers, but the phrasing and order varied 
according to the flow of the interview and Shifts fxom English to 
Spanish. In addition to the pre-established interview protocol, other 
topics were probed when teacher comments suggested alternate areas of * 
.interest. . The x interviews fopused on the following topics:. 
^A. Lommentar ies about the class. B. Training and Training Activities. 
C. Parent Participation, D. Curriculum, and E. ^Interaction with the 

Administration. 

* ♦ 

Findings 

The findings are organized around the interview topics. 

C-3 
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A. Commentaries about the ^iass.- <- 

English was the predominant instructional language in every Pre- 
Kindergarten class of th'e'Title VII Program. There were wide 
, variations in English proficiency within each class. To accomodate 
this situation* students worked in small groups for basic it^truction. 
The composition of the groups changed throughout the year whenever the 
teacher thought such a change was^in the best interest of th^ child's \ 
learning progress. / 

Every teacher reported having discipline problems. However, all of 
these problems were resolve^ without .undue disruptipns of normal ^lass 
activities. Dealing with such problems constituted^ one of the goals 
of this Program. Teachers prepare children to deal, with school routines 
and behavior standards. 

Present Program guidelines call for a class composition of 15 LEP and 
'three Non-LEP students. It was anticipated that the* three Non-LEP 
children would<provide English lariguage models for f the LEP pupils. 
Teachers observed a mutual influence between these groups, but not* 
that some Non-LEP pupils probably did not fulfill the model funct 
In 1 general, teachers feel that the^ current composition (15 LEP ar 
3 Non-LEP) is Appropriate. One teacher, however, would like toyfeduce 
the number of children /per class to 15. 

B. Training Activities t 

t 

The TitletVII Pre-Kindergarten teachers constituted a heterogeneous 
group with respect to experience. There were three teachers with 3 years 

' or ikoTe of bilingual teaching experience while the oth&r three had less 
than 3 years of experience. The distinction is an important factor in 

* the teacher's evaluation of the training component. 

vTh4re were four inservice training activities planned and implemented 
by Qie Program's administration.' Attendance was mandatory. The lets, 
experienced teachers indicated these training sessions were beneficial. 
The others did not. However, there were two training Sessions that kll ' 
teachers identified as meeting their expectations and needs. One of 7 
these' was a workshop'on Science for the Young Child, and the other was 
a session on Math for the P re-school Child conducted by the Curriculum 
Specialist. Thus, some training topics were identified as relevant by 
all the Title VII teachers. . * 

To enhance the inseirvice training for the next yeat, teachers were asked 
,to suggest training' topics that would satisfy their needs. The suggest- 
ions were as follows; • * 




a. More training in the curriculum. 

b. Discussion and advice on language of instruction, especially 
for - concept development. 

c. Training and recommendations regarding , the treatment of motor 
\^ ?kill problems. # 
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d. More training sessions on science t'opics for Pre-Kindergarten. 

e. To continue with* the inservice in-classroom training, but with 
.more comments, and suggestions, f rom J:he specialized staff. 

C. Parent Participation ✓ 

An important 'component of the Program was Parent Participation. Every 
week parents* of children participating in Title VII Pre-Kindergarteiy 
were given instructions for activities to be conducted at home to com- 
plement classroom activities"^ Teachers were aware of the instructions 
that were sent home *ut did not' participate in their design nor did 
they have a way to monitor their accomplishment. / 

Teachers indicate that^some parents were supportive and directly in- 
volved with a number or&ia^sroom activi tie£f,~Tield-trips , and speciai 
programs such as the Cinpo de Mayo celebrations. 

The teachers had a chance to meet frequently with almost all the parents 
in an informal manner. The brief c<?ntacts provided the basis for normal 
teacher-parent communication. However, formal' conferences were scheduled 
to address special problems. 

There were no special activities implemented by the teachers to involve 
parents in the education process per se. 

D. .Curriculum 

During the 1980-81 school year, the Title VII Pre- Ki*4&££arten used the 
Bilingual Early Childhood Curriculum (£ECC) The main objective 
within this topic was to find out 'if this curriculum fulfilled the aca- 
demic--^ linguistic needs of the children^ Teachers feel that the BECC 
satisfies the needs of younger children and/or children with less 
developed language but fails to challenge those pupils' at higher levels 
of language develGpment. The major point of dissatisfaction with the 
BECC was that it is too repetitious. 



E. Interaction with the Administration 

The teachers offered the following suggestions for Program improvement 
In the administrative area: 

.Treat Title VII teachers as full-fledged members of the school 
. and invite them to all teacher's meetings. 

.Have principals conduct classroom .observation and share 
opinions and suggestions with the Title VII teachers. 

.Maintain better communication bet\fesn the Title VII adminis- 
tration and support staff and the Project schools. 
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Conclusions 



Overall, teachers were satisfied with .the Program and feel it plays 
essential role in the language development of Pre-Kindergarten LEP 
children. ' ^ . 



\ 
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' Page 1 of 3 

Interview Protocol for Teachers of Title VII Pre-Kindersarten . t J 

A. Opinions and Commentaries on thejClass . 

« • 

1. What language predominated in your classroom? j % Spanish %English. 

'v • . • * - 

2. You divided wur class into several groups. What was the criteria for the grouping? 
Are you satisfied with this grouping? Will it change next year? 



3". Did you keep the composition of the groups the same all year long? Please explain. 



■ \ 



4. Did you have any children with special problems? If so, were they disruptive to 
the class? v f 



B. Training and Training Activities . * 

1. What Title VII training activities did you attend? 



2, Did you" find these activities beneficial to ycrd? 

3. tfid the type of training offered meet your needs? How? 



4. With respect to next year, wha't topics should be considered for inservice training? 
Are these inservice training topics essential?, a strong need?, or a moderate need? 
Please elaborate: 



5. Did you find in-classroom training an effective, unobstrusive method? Do yotl 
feel some other method would be better? If so, what? 

ERIC 
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C. Pargxvt Participation . < 

Parents weVe expected to work at home with the childten in certain structured 

activities. Sometimes they were asked to build something, for example a building 
with a shoe-box. 

^ , • a) What other activities were parents asked to do? _ * 



b) Hoft many of the students completed their "homework" assignments. 



2". Did ybu^kave a chance to meet with all the parents to inform them about the progress , 
and/or problems of their child? Explain, please. 



3. List the parents whom you f eeL were very involved in the Program CConf identiality 
will be maintained. Achievement of the program children of these families will be 
'ccompared to the achievement of others in the class.) * 



\ 



4. What activities did you implement to involve parents in the education process: 



D. Curriculum . * ' • * ' 1 

*1. Did you use the Early Childhood Bilingual Curriculum as it was?, Did you make 
/ major modif icatioras? If so, what taodif ications did you make? 

2. Are there iny areas of the ECBC that you feel need to be added, modified, or. deleted? 
Please explain. 

3. In your opinion, is the E,C.B.C.« responsive to J:he skill development needs of your 
pre-school students?' What are its strengths and weaknesses? 



r 
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E. Administration * . 

I. What administrative problems occurred this year? 



2. Do ymi have any recommendations that would alleviate these problems in th$ future? 



J 
I 

J 



3. Was your cla^s disrupted frequently by administrative and supervisory personnel? 

4-« To .what extent did you have the opportunity to work cooperatively with the other 
* Title VII Pre-K teachers with the objective of improving classroom instructions? 



5. Please indicate any recommendations you have # that "you feel .would enhance the 
program's effectiveness If implemented? 




-9 
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Instrument Description: Early Childhood Observation Form - Part B 



Srlei description or the Instrument; ^ , « 

Structured Classroom Observations were baaed upon the* Early Childhood 
Observation Form - Part B. It is a record of minute per minute school 
activities following a pupil for the entire school day. Several variables 
are recorded such as language used, average, group si2e, -minutes of structured, 
unstructred and non-instructional activity, and person providing instruction. 



Tp whoa vas the instr^^t a^^nistered? 

To* randomly selected LEP children in Title VII Pre-K classrooms. 



Bow many times vas the instrument administered? 

Fifteen times. "Three observations were held per class In five schools. 



When vas ttre Instrument administered? 

The observations were conducted during March and the first two weeks of April. 



Where was the instrument administered? 

& 

The observations were conducted in all Pre-K Title VII schools except Brooke. 



Who administered the instrument? 
An observer vas hired for this task. 



What training did the administrators have? 

The observer received training, including a practicum, in the appropriate 
observation processes. ^>~- 

v ' 

Was the Instrument administered under standardised conditions? 
Yes. 

t 

Vera there problems vith the instrument or the« administration that might 
affect the validity of the data? 

Hone. 



Who developed the instrument? 

O.R.E. S> 

• y ) 

What reliability and validity data are available on the instrument? 

Since only one observer was employed, there were no interrate*r reliability 

tests. However, previous tests held during 1J|0 yielded high coefficients,. 




iajo 



Are there norm data available for Interpreting the results? 



"No. 
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• Purpose 
» • • 

The purpose of the Classroom observations -#as to address the following 
decision and evaluation questions,; 

Decision Question Dl ; What components of the Program should the 
District assume? 

> * 
Decision Question D2 : What components of the Program should be 
modified^tp' accomplish, the objectives of the Program more fully? 

Evaluation Qgestlion*Dl-l : -What is the nature of the Program? 



Evaluation Question Dl-4 : How is time utilized by the Title 
VII Pre-K Program? 



* Procedures 

*Two types of classroom observations were implemented, structured and 
unstructured. The first, and second visits to each classroom were 
unstructured* In these the observer familiarized himself with the 
environment, the personnel, and the routines of the day's activities. 
The structured observations (three days for each class) were based 
upon the Early Childhood Observation Form. This instrument* was 
selected to record, the activities of randomly selected LEP students 
for the entire school day. The first visit was announced. Thfe other 
four were not. The observations were conducted during March and the 
first two weeks of April. 

V * 

1 

After the unstructured observations were completed, an observer was 
hired specifically to conduqt the structured observations. She received 
training, including a p/act'icum in the appropriate observation processes 
The observation examined such variables as language used during instruc- 
tion, average group size, relative amount^ of formal and informal in- 
struction, and amount of time various adults welre insfructiorially 
involved with students. 

n*, , 4 > , 

Observations' were not held at Brooke this year since the teacher was 
absent due to health problems.' 
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Findings 

Title VII Bilingual Pte-Kindergarten participants attended^ school for 
390 minutes per day. The week lasted the regular five school days. 

The school day f s time was classified into the following three categoties 

\ - • 

Structured Instruction: Time dedicated to structured learning 

activities. These activities were oriented 
chiefly to develop language, audio, visual, 
and motor skills of the participants and 
to develop new concepts and ideas. 



Unstructured Instruction: 



Noti-Insturctional : 



Time Medicated to recreational acitivies, 
free time, transitional minutes from one 
activity to the other, and unstructured 
learning activities such as working alone 
in* one of the centers (art, housekeeping, 
blocks, etc.) . 

time used for the following instruction 
breakfast, lunch, a nap, and a. short snack. 



Actual Available Class Tim$ (AACT) is that part />f the school day 
dedicated to instructional activities and amount\ on the average (from 
fifteen observations), tp .280. 6' minutes per day*. YSummaijy statistics 
for the observations may be found in Figure D- \f \ 



V 








► 


> - 
Time Classification 

4 


r 

Total Time 


Mean 


t of 
School Day 


% of 
AACT* 


Structured Instruction 


♦ 

2166.00 


144.4 


37.03 % 


51.47 % 


Unstructured Instruction 


2042.00 


136.1 


34.91 % 


48.52 % 


Non-Ins t rue t ianal . 


3,641.00 


109.4 


28.05 Z- 


N/A 


Total 

N 15 observations 


.5849.00 


389.9 


100.00 % 


100.00 % 



*AACT: Actual Available Cftass Time 

Figure D-l. Statistics from Classroom Observations. 
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Figur.e D-2: Illustrates how time was used during the school day 
aiid its distribution during MCT. 




SCHOOLOAY* 390minutes' 


^AACT 280.8 mmut«a~ 


y Typf of Activity 


Hun nln. "ptr * 


Structured Instruction 


144.4 


Unstructured Interaction 


136.1* 


1 Son- Instruct ion 


103.4 


* Actual AvalUbl* CLa««rooa Tla*. 





• Figure D-2. DISTRIBUTION OF TIME. . . . 

Observations also indicate that -teachers were the* chief providers 
of structured instruction ' (76 % or 110.4/144.4). The teachers/ aides 
were also in charge. of providing instruction but to a lesser extent 
(22 % or 31.5/144.4). The remaining structured instruction was pro- 
vided b.y a music teacher and' a physical education coach. 

It was observe^ that structured instruction was provided in English, , 
Spanish and a mixture of English and Spanish. English was the pre^ / 
dominant language of structured instruction. For the pupils observed,* 
the teachers taught about 66 % of the time in English and 10 % in 
Spanish and/or a, mixture of Spanish : a nd English. The teachers* aides 
also taught -in both languages. The proportions observed for aides 
while' involved in structured instruction were {the following: Engltsji 19,%, 
Spanish and Mixture of Spanish and English 4 %. Figure D-4 depicts the 
time distribution when "Person in Charge of Instruction" and "Language 
of Structured Instruction" was observed in combination. 
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r 

ADULT PROVIDING INSTRUCTION 
Teacher \ Aide 



English 



Language 
of 

Instruction 



Spanish 
& 

Mixed 



„ 66. 2 % 


18.9 % 


/ 

10.5 % \ 


1 4.2 % 



Figure D-3. 



PROyiSION OF INSTRUCTION BY LANGUAGE AND 
PROVIDER. 




All teachers used pre-lunch time to provide Structured formal teaching. 
The teachers divided the class into groups of six to eight cfti^ren 
4nd worked with each 'group for a period of twenty-f iv<=» minut^ on a 
rotational basis.' Concurrently, the aide conducted a separatfc session 
with another group. The members of othe£ groups were sent to the centers 
for independent activity such as painting, drawing* or working with 
blocks . 

Another difference noted was the bathroom vis it procedures. Two 
tjeachers allowed the children to £o on an as-needed basis while others 
filet aside a .specific time for all to go. Observations suggest that 
valuable instructional time is often lost when all children go at the 
same time due to coordination and discipline problems that arise with 
large groups of young children. % 
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80.79 Instrument Description: Parfenc's Questionnaire 



3riel deacriptionrof the instrument : „ * 

The Parentis Questionnaire consisted of 10 questions. Ic was written in English 
and Spanish.* The questions addressed several topics: 'recruiting, parent in- 
volvement and extent of implementation. 



To wfaea was the Instrument administered? 

To all parents of the children participating in. Title VII Bilingual Pre-Kinder- * 
garten. 



Hov many times was »V« <*« grmnene administered? 
Only once. 



When was the Instrument administered? 

The questionnaires were delivered on the second week or May 1981. 



Voere was the Instrument administered? 

the questionnaire was delivered to the home by che children. 



Who administered she ^scrument? * 
Self -administer eo 



What training did the administrators have? 
Not applicable 
I 



Vast the Instrument Administered under standardised conditions? 
Not^ applicable 



Vera there problems with the instrument or che administration chat sight 
* affect che validity 0 f che data? 

S'otfe known 



Vho developed the instrument? 
Martin Arocena 

> 

What reli ability and validity data ire available on che instruaent? 
tfone v - ^ 



Are there norm data available for Interpreting che results? 



No. 
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Parentis ^Questionnaire 



* u Purpose 

The purpose of the Parent's Questionnaire was to address the following 
decision and evaluation questions: 

T 

Decision Question Dl : What components of the Program should the 
District assume? ' 

* * 
Decision Question D3 ; What components of the Program should be 
modified to accomplish the objectives of the'Program more fully? 

Evaluation Question D-7 : Was the Parental Involvement com- 
ponen t imp 1 emen ted? ^ 

Evaluation Question D3-8 : Are' par^ts participating in the 
activities? , To what Extent? ^> 

Evaluation Question D3-9 : ' How do limit^ English parents 
interact with the schools? 



v Procedures-jroCollect Data 

The questionnaire wa^ delivered via the children in the program to all 
the parents of participating qhldren in Title 711 Pre-Kindergarten 
Program. To optimize the chances of obtaining a -Sarge rectum, each 
child was given a book upon returning the completed questionnaire. The 
strategy was apparently successful, since 89.1% (90/103) of "the ques- 
tionnaires were returned. 

The questionnaire consisted of 10 items. Eight of them were "fixed- 
alternative 11 questions. The other two were "open-ended" .^f The , 
questions covered the following three topics: Parental Involvement, 
At-Home activities, and Recruiting. ^In addition to these topics the 
Respondents "were asked to make suggestions regarding changes that 
would enhance the Program. The findings, section is organized around 
the following topics: 

. Parental Involvement 
. At-Home Activities 
. Recruiting 
. Parent Suggestions 
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, * Findings . , 

Parent Involvement 

Results of self-reported attendance indicate that parents are truly , \ • 
interested in participating in the Program and schoolV ctivities * 

* ' 1. 57 cases 63% Attended meetings with school personnel , ' 

to ctalk about how to teach their children 
and to receive instruction for the At-Home 
Program. 

2. ' 72/^ases 80% Attended meetings with teachers to find out 

how their chil4 was doing in school. 

3. 59 v cases 65% Attended PT^nee tings. ^ 
Figur^E-1. PARENTAL ATTENDANCE TO SCHOOL ACTIVITIES. 

Ninety- four per cent ©4/ 90) of the respondents felt that Pre-Kindergarten 
was .helping their -child to learn new words in EnglisTT^and Spanish, to 
recognize colors and shapes, to listen more carefully, and to express 
feelings verbally. 

Ten of the parents who ^nswered in Spanish/reported that the most im- 
portant thing that their child had learned in school was to speak in 
English. It is lffceiy that these parents are Spanish dominant or 
monolingual, and feel the need for their child to learn English from 
sources outside the home. 

In general, parents felt that the most important thing* that their child 
learned in school was to act in a more independent manner, to interact 
peacefully with other children, new words in English and Spanish, and 
to respect authority. The following is a typical response: 

' f, My child learned to speak her words in sentences, ( 
English and Spanish. She learned to understand y 
and listen to parents. Also numbers, colors, to 
share things and to get along with kids. J 1 

The answers to the questions dealing with program awareness indicated 
that parents were cognizant of their children's progress. They also 
suggest that at ledst from the parent ' point of view, gome of the 
Program's objectives were achieved. ^ 




ERLC 



.E-4 

\ . 3/ 



80.79 



At-Home Activities . * / 

J 

Eighty-seven (96%) of the respondents felt that the instructions for 
the At-Home work were very easy to tinders t^ad, 



One of x the parents who answered the questionnaire offered this suggestion: 

"Have different levels of difficulty for the 
At-Home work my child was above the* level of- 
fered. The activities were too easy." 

Results indicate that it was mothers who helped with the At -Home activi- 
ties. Three responses indicated that fathers helped out*, and in two, 
instances ' grandmothers were mentioned a§ being the At-Home instructor. 

< 

Recruiting / 

The questionnaire included art item designed to identify how parents 
found out about the Program. Results (see Figure C-2) show that most 
of the. parents found out about the Program indirectly from other 
parents and relatives • However, School personnel and community 
representatives were another important source of information* News- * 
paper ads were not a very effective communicator since only two cases^. 
indicated learning about the Program from this 6ource, T.V. and radio 
were more effective however, none of the sources can be dismissed as a 
means of recruiting children for the Program since there is no informal 
tion on how "other parents" and "relatives* 11 obtained their information. 



c 



Source of Information 9 Parents 
T.V, and Radio 

From other parents 33 

From other relatives 14 

Newspaper ads 2 

Church 3 

School Personnel 24 
Community Representatives 17 

Figure E-2: INITIAL SOURCES OF INFORMATION OF PARTICIPATING FAMILIES 
REGARDING THE TITLE VII PRE-KINDERGARTEN 

Parent Suggestions ^ m t 

The following is a list of suggestions provided by the parents of children 
participating in the Title VII Pre-Kindergarten Program. 

"Perftaps have two or three levels of At-Home activities depending 
on child's development. My son is beyond some of the activities." 
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"Have more parents as well as chflLdreJ^ involved in the Program. 
To me, ray son has learned much more than I could have ever 
done. I am glad he had the chance to be involved and so am I." 

"They could, teafch and/or use more Spanish." 

"Regular evaluations of the childrens* progress fer the parents. 
It isn r t always possible to get to school to discuss it with 
teachers . 11 , c 

"I think f th^Program should continue so that children can be 
exposed, to their cultural language through songs and cultural j/ 
, dances. I also feel the Program is very well planned and % well 
organized." 

"To start on the Phonics Program and simple three-letter words." * 

"I think they should have more outside activity." 

"I hope they keep the Program because it helps a lot of children 
that don't know their Spanish. It also helps them get ready 
for the coming years." 

"I would like to see more school personnel cooperate with the 
Program." 

"I think the Program is fine but, would like to see more children 
involved or given the opportunity to 'participate in it." 

"The children need to learn better pronunciation of words in 

" both 'Spanish and English." 
( 

""I wish there was a form of transportation for my child. " r 

"I feel one needs to put more emphasis' on the Spanish language." 

'Have parental meetings so one cSn help better the Program and 
the progress of the child." s 

"To individualize more, according to ability instead of clustering 
all students together. More oral Spanish instruction instead of 
just vocabulary emphasis." , 
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TOUR, PERCEPTIONS: QUEStlONNAIRE FOR PARENTS OF PUPILS IN THE TUL? VII 
PBIHCIMDESCARIEH 

tHE oma O? RESEARCH AMD EVALUATION 0? THE AUSTIN INDEPENDENT SCHOOL DISTRICT 
IS SENDER THIS QUESTIONHAIRE TO ALL PARENTS OF THE CffTT.DRlK IN ? RE-KINDERGARTEN 
TITLE ta TO R ECEIVE INFORMATION ABOUT THE PR OC&AM . WE WOULD APPR ECIATE TOUR 
ANSWER TO THE* QUESTIONS BELOW. WHE8 " RETURNS THE COMPLETED QUESTIONNAIRE 
TO THE m <Tm HE/SHE WTLlV eCEIVK A GIFT OF APPRECIATION. THANE* TOO ^ 



I. 
2. 
1. 



5. 



What ere the ages of your children? (List the ages): 



What la nguag es) <*° u** °°* c °* cta * c (Circle one) : Spanish 



Who helps the # child at hoot with school 
work aosc often? (Circle one) : 

A* THE MOTHER 

3* THE FARTHER 

C. THE GRANEKOTHER 

D. AH OLDER BROTHER OB SISTER 

E. OTHER: (WHO?) : 



Who told you what parents vara axpactad 
to' do to help the children? 4 (Circle one) : 

A, THE COMMUNITY REPRESENTATIVE 

3. THE SCHOOL PRINCIPAL 

C. THE TEACHER * 

D. OTHER (SPECIFT) : ' 




k 1 J. fot«sU* 



Have you gon« to any of these activities? (Circle YES or NO) 
YES 50 



YES 



NO 



Meetings with school personnel to talk about how to ceach your 
' children and to receive Instruction for the At -Home activities? 

Meetings with the teacher to find how your child is doing in 
school? 



r? 



YES NO PTA Meetings, 
'♦6*. Do you think ?ra-*indergarten is helping your child? (Circle YES or SO) : 



YES 
YES 
YES 
YES 
YES 4 



NO 
NO 



NO 
NO 
SO 



To learn nev words in English? 

To learn aev words in Spanish?- 

To ctcognize^ colors and shapes? 

To listen ^aore carefully. % 



To express feelings verbally. 

Are the Instructions for ehe t At-Hcme activities easy co understand? 
(Circle one) : * 1 

A. Yes, they are very easy. 3. No, I chink they are difficult. 

C. Other (specify) * 



3. How did you find out about the Pre-iCindergartan Program? 
(Circle all the answers* chat correspond) s v » 

A.**T.V. AND RADIO S. NEWSPAPER ADS 

3. FROM OTHE R PAR ENTS F. FROM CHURCH 

C. FROM REUITVES G. FROM SCHOOL PERSONNEL 

D. FROM THE COMMUNITY REPRESENTATIVE , 

9. What Is the aost important thing your child has laamed so far in school? 



Pleaee axplaln in your own words: 



10. Do you have any suggestions or ideas that would help us sake the Pre-tCiader- 
garten Program better? 
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5yS IMPRESIONES: CUESTIPHARXD PARA L0% EAtHUABES is LOS ESTtJDlANTES DEL 

pm^oIto (nmo vti) • . ^ 

LA OFICISA US T EVALtlACtOHES CORE) BEL DISTRllO ESCOLAR DE AOSTO 

(AISS) LES EU7ZA ESTE CUESTIOHARIO A TODOS LOS FAMHIABES DE LOS ESTUDIAMTES 
Of EL PRE-GHDERGA8IEB PAfcA QUE SOS DE2f , IHFO BjKACI (5n 5 OB RE a PROGRAHA* CUAHPO 

TSAIGA EL ,CUESTIOHAJaO CONTESTAfiO, LA MAESTRA LS'DARA UN BECALO* . 

MUCHA3 GRACIAS* w 

1. iCuAntoa ado a ciantn sua niioa* (EscribmJLo) ; T * 



2. 
3. 



4. 



tQuf idiot aa uai aaa an sua casaT (Marqua uno) : 

jQu£an ayuoa> 4 uti aino(i) con 1a carts 
atcoiar la cat*? (Mar qua uno): 

" aT lkW& ' 

3, U' ABUZLA 

C. UN HEEMAKO(A) MAJOR 

D. a PADRE , 
2m OTBA PERSOHA * (QOiEH?) : 

* 

iQulau It inforao sobrt lo gut dabian 
hacar lot padraa an aaca Programs? . 

A* EL 'PRINCIPAL {Qs DIRECTOR) DE LA ESCUELA 
3* U HAESTRA • T 

C. OtSOS PADRES 

P." * LA REPHESE8TA£rtE DE LA COttKIDAD 
2. 0T2A PERSOHA » 



XSGlIs ESPAFOL 




5. 



liMJX aaiacido Uactdas a alguna da aacaa /accividadaa? (Marqua SI o X0): v 

SI SO Juntas con ai paraonal da la aacuaia para cotaparcir idaas sobrt 

ccao aduear a loa ai2oa. -» 
* • 

SI so 



Jwacaa dal PTA (AJociacion da padraa 7 aaaacxas) . 




SI SO * 7isicaa a la aaaapa para_ ayariguar como 1% va al aido an la aacual 
» i^ianaVuacad qua la' aacuaia aaca ayudaado a su uiao? (Marqua SI or XO): 

y I 

A aprtndar nuavaa palabraa «n Iagiaa. 
A aprandar ^nuavaa palabraa an Sspanolt 

A racouoctr foraaa 7 colorta* * • 

aca. 



SI HO 



A aacuchar saa acantajaanc 
A axpVaaar sua sandaiancoa aaa acancacaaanca. 



7, 



&La paraca a Uacad qua Ua iaacruccionas para laa accividadas tn la caaa 
son facila* da ancandar? t 

SI t Son ca^iiaa da ancandar ^ S0„ Son dif £cilaa ; \. 

!CSao aa ancaro Usctd dal Program* da Prt-Siadargarcan?, (Marqua codas Us 
raapuaacaa qua corraapondan) : , 

A. f POR MEDIO DE LA TSLEVTSfON 0 RADIO 
3. POR ISTERMEDIO* DE OTROS PADRES 
C. SOS LO DUO U HORESENTANTS ^ UCOMlmiDAD 



D. POR AVISOS 'SI 2L DIARIO 
S. POR^ EITERMEDIO DE LA 
tCIXSIA 0 CNa 0RCAMI2A- 
CfOK DE .U C02H79IDAD 



9* iSagua (JacadJ qua aa lo aia ioportanta qua halaprandido su oino al 

haaca ahora? Eapli<ua an sua pr^piaa palabrai: ™ 



scuala 



10. itiana Cacad alguna? idaa^suVaraacia qua noa quiaiara dar para aajorar al 
Prograaa da ?ra^£iadar?ajrcau?: a . ^ > " 1 



Zxpliqua an sua pcooiaa palabraa: 
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DOCUMENTATION JRGM BILINGUAL EDUCATION DEPARTMENT 



r 

Purpose ' 9 

Documentation from Bilingual Education Department was provided to address 
the following decision and evaluation questions: ^ . 

Decision Question D3 : What components the Program should be modified 
to accomplish the objectives of 'the Program more fully? 

Decision Question D4 : What are the various costs associated -rtith the 
Program? 

Evaluation Question D4-1 : What was the cost of Implementation of 
the first year? • v x * 

) 

Evaluation Question D4-2 : What is the projected maintenance cosfr? 
Evaluation Question D4-3: What is the Program's cost per child? 



Documents , ^ 

The following documents were provided by the Bilingual education Department 
conqerning Title Pre-Kindergarten Program: 

A* Complete roster of students. 

B. Teacher 1 s report of preservice activities. 

C. ^List of inservice training session. 

D. Records of PAC meetings. 

E. Records of parenting seminars. 

F* Budget information. , ^ 



Findings 

The documents' provided the basis for the following* information and findings 

A. Complete roster of students. 

ft * 

The records provided include a list of % all the students with* entry and 
withdrawal records. The Program plaftned to serve 18 children per site, 
figure E-l illustrates the enrollment numbers per month* 



'80.79 



By January the Program was nearlng its planned capacity and by February 
all participants slots had been filled. Frpm then on early withdrawals 
from the Program "were rapidly replaced by alternates. There were twelve 



early withdrawals in total. 
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*Note: Sanchez Elementary did , not report enrollment until December. 
Figure F-l. ENROLLMENT OF STUDENTS IN TITLE VII PRE- KINDERGARTEN. 
B. Teachers 1 . Report of Preservice Activities.* 

* - 5 

In the Reports of Preservice Abtivities the teachers specified their activi- 
ties from the moment they were hired until the first day of classes- The 
activities reported include discussions of the BECP, organization of their 
classrooms, PAL test'administration training, PAL test administration, 
enrollment of students, and conferences with parents. 

Three reports were turned in to the administration. Two teachers did not 
comply* with the Request for reports. The sixth teacher was not hired until 
these activities ha£ been completed and thus was exempted from the endeavor-. 
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C. List of Inservice Training. 

The following were the topics of the inservice training: ' 

• Art and the Young Child. 

• Creative Dramatics. "* 

• Science for the Young. Child. 

• frlath for the Preschool Child. 

Attendance at these sessions was mandatory. Some teachers, however, did 
not participate fully. Only three teachers attended the first session. . 
There was one abscence in each of the other five sessions. 

Records on^PAC meetin^l 

There were six meetings of the Parent Advisory Conmittee this year. PAG 
activities are not exclusive for parents of Title VII Pre-kindergarten 
pupils, however, they were invited to attend and participate in the activi- 
ties. The goals of the association were the following: 

, t To be informed parents about the Bilingual Education Program. 

• To obtain ideas and suggestions from parents regarding the 
Program. 

• To become involved in the educational system. * 

This year, according to the records provided, parents \>f Title VII Pre-Kin- * ' 
dergarten were actively involved. Four parents of the Program f s children 
'were officers of the association. On .the average 12 parents from Title VII 
Pre-K were present at the meetings. 

Parenting Seminars. ^ ** j 

Two parenting seninars were organized by the Title VII Pre-Kindergarten' s staff. 
The topicp were the following: * 

• Parents Are Teachers Too. 

• Art. 

The first seminar was held at four different times to accomodate the different 
schedules of participating parents. Sixty-one parei^S attended. Twenty-fbur_ 
parents attended the. second session. 

Budget. 

The federal appropriation for the first year of the Program was $291,538.00 
In addition to that the District appropriated $57,375.00 for a tQtal ^ 
amount of $348,895. Reported expenditures as of 5/31/81 amounted to 
$201,385, According to the figures to date the cost per child was $1,864.68. 

F-4 
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The Project Coordinator estimates a projected cost for next year of $288,507.00 

The Title VII staff did not" provide any records w^th respect to the At -Home 
activities. From a personal communication with the Community Representative 
it was found that 24 activities were sent home. 
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BOARD QF TRUSTEES 

Will ^D. Davis, President 
, Nan Clayton, Vice President 
Manuel Navarro, Secretary 
Steve M. Ferguson Peter W. Werner, M. D. 

Ed Small Jerry Nugent 



SUPERINTENDENT OF SCHOOLS 

Dr. John Ellis ' 



DIRECTOR, OFFICE OF RESEARCH AND EVALUATION 

Dr. Freda M. Holley 
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